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EXECUTIVE  SUMMARY 


This  document  provides  the  test  philosophy  and  approach  for  the 
Offshore  Next  Generation  Weather  Radar  (NEXRAD)  Test  and 
Evaluation  Master  Plan  (TEMP) . 

The  NEXRAD  differs  from  the  typical  Federal  Aviation 
Administration  (FAA)  weather  radar  acquisition  in  that  it  is 
jointly  funded  by  the  Department  of  Defense  (DOD) ,  the  Department 
of  Commerce  (DOC)  and  the  Department  of  Transportation  (DOT) . 
These  three  agencies  chartered  the  Joint  System  Program  Office 
(JSPO)  to  manage  the  NEXRAD  development  and  subsequent  test 
programs.  JSPO  has  deployed  70  single -channel  radar  systems 
across  the  continental  United  States  (CONUS) . 

The  FAA  is  deploying  NEXRAD  systems  at  non-CONUS  (offshore) 
locations  such  as  Alaska,  Hawaii,  and  the  Caribbean.  The  FAA 
Offshore  NEXRAD  will  have  a  redundant  configuration  and  a  Remote 
Monitoring  Subsystem  (RMS) . 

Initially,  a  NEXRAD  TEMP  addressing  all  National  Airspace  System 
(NAS)  specifications  went  through  the  clearance  process  and  all 
comments  were  resolved.  However,  upon  further  assessment  of 
costs  and  previous  testing,  the  NEXRAD  Program  Management  Office 
(PMO)  decided  to  have  the  NEXRAD  TEMP  rewritten  to  primarily 
focus  on  the  FAA  enhancements  to  the  NEXRAD  system.  This  revised 
TEMP  concentrates  on  testing  the  NEXRAD  enhancements  and  not 
retesting  features  of  the  operational  single -channel  NEXRAD 
system.  Testing  described  in  this  document  will  not  address  the 
NEXRAD  Principal  User  Processor  (PUP)  since  it  has  successfully 
completed  a  full  operational  evaluation. 

A  total  of  14  Offshore  NEXRAD s  will  be  procured  under  this 
acquisition:  3  in  the  Caribbean,  4  in  Hawaii,  and  7  in  Alaska. 

Funding  constraints  will  limit  the  acquisition  to  seven  NEXRADs 
in  the  1994-1995  timeframe. 
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1.  INTRODUCTION. 


The  Next  Generation  Weather  Radar  (NEXRAD)  program  establishes  a 
weather  radar  network  which  will  provide  accurate  and  suitable 
aviation  weather  products.  The  Joint  System  Program  Office 
( JSPO)  completed  Operational  Test  and  Evaluation  (OT&E)  of  the 
single -channel  NEXRAD  in  1989,  although  Developmental  Test  and 
Evaluation  (DT&E)  continued  through  1990.  The  single -channel 
NEXRAD  system  is  currently  being  deployed  in  the  continental 
United  States  (CONUS)  for  use  by  the  National  Weather  Service 
(NWS) ,  the  Federal  Aviation  Administration  (FAA) ,  and  the 
Department  of  Defense  (DOD) .  The  FAA  will  procure  through  JSPO, 
off-the-shelf  NEXRADs  in  a  redundant  configuration  and  the  FAA 
will  then  add  the  Remote  Monitoring  Subsystem  (RMS)  capability  at 
a  later  date.  These  FAA  redundant  configuration  NEXRADs  will  be 
deployed  to  non -CONUS  locations  and  hence  are  referred  to  as 
Offshore  NEXRADs.  A  total  of  14  Offshore  NEXRADs  will  be 
procured  under  this  acquisition:  3  in  the  Caribbean,  4  in  Hawaii, 
and  7  in  Alaska.  First  site  testing  will  be  performed  in  Kauai, 
Hawaii.  This  document  addresses  the  testing  of  the  two  FAA 
enhancements  to  the  initial  system:  redundancy  and  RMS. 

1.1  SCOPE. 

This  Test  and  Evaluation  Master  Plan  (TEMP)  describes  test 
requirements,  general  methodology  and  responsibilities  for  DT&E, 
OT&E,  and  Production  Acceptance  Test  and  Evaluation  (PAT&E) 
testing.  The  testing  is  limited  in  nature  due  to  the  extensive 
testing  already  performed  on  the  single  channel  NEXRAD  by  JSPO 
and  funding  shortfalls.  The  scope  of  testing  will  primarily 
address  the  FAA  enhancements.  This  testing  will  consist  of  two 
phases:  redundant  configuration  and  RMS  testing. 

1 . 2  BACKGROUND . 

The  NEXRAD  system,  developed  by  the  Unisys  Corporation,  is  an  "S" 
band  doppler  weather  radar  capable  of  detecting  the  location, 
severity,  and  movement  of  both  routine  and  hazardous  weather 
phenomena.  Since  1991,  Unisys  Corporation  has  been  the  prime 
contractor  on  the  project.  The  JSPO,  through  the  Air  Force 
Operational  Test  and  Evaluation  Center  (AFOTEC) ,  completed 
operational  testing  of  the  NEXRAD  in  1989,  although  DT&E 
continued  through  1990.  The  JSPO  NEXRAD  systems  are  currently 
being  deployed  for  use  by  the  NWS,  FAA,  and  DOD. 

The  single -channel  NEXRAD  systems  lack  a  redundant  configuration 
and  have  no  RMS  capabilities.  To  satisfy  National  Airspace 
System  (NAS)  requirements,  the  FAA  will  procure  through  JSPO, 
Offshore  NEXRADs  which  are  off-the-shelf  JSPO  NEXRADs  in  a 
redundant  configuration  and  add  RMS  capabilities  under  a  separate 
procurement  effort.  These  Offshore  NEXRADs  will  be  procured, 
installed,  and  maintained  by  the  FAA  for  locations  in  the 
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Caribbean,  Alaska,  and  Hawaii,  to  enhance  existing  equipment 
availability. 

Unisys  is  the  prime  contractor  for  the  redundant  configuration, 
while  the  RMS  will  be  procured  by  the  National  Engineering  and 
Field  Support  Division,  AOS -200,  in  conjunction  with  the  Program 
Office . 


2 .  REFERENCE  DOCUMENTS . 


2.1  FAA  DOCUMENTS. 


2.1.1  FAA  Specifications. 


NAS-SS-1000 


NAS -SS-1000 


NAS-SS-1000 


NAS  System  Specification,  Volume  I,  Functional  and 
Performance  Requirements  for  the  National  Airspace 
System  General,  October  1992. 

NAS  System  Specification,  Volume  III,  Functional 
and  Performance  Requirements  for  the  Ground- to -Air 
Element,  February  1993. 

NAS  System  Specification,  Volume  V,  Functional  and 
Performance  Requirements  for  the  National  Airspace 
System  Maintenance  and  Operations  Support  Element, 
October  1992. 


2.1.2  FAA  Standards. 

FAA-STD-024B  Preparation  of  Test  and  Evaluation  Plans  and  Test 

Procedures,  August  22,  1994. 

CT  1710. 2B  Preparation  and  Issuance  of  Formal  Reports, 

Technical  Notes  and  other  Documentation,  February 
13,  1990. 


2.1.3  Other  FAA  Publications. 


NAS -MD- 790 


NAS -MD- 79 3 


FAA  ORDER 
1810. IF 


Remote  Maintenance  Monitoring  System  Interface 
Control  Document  (ICD) ,  Maintenance  Processor 
Subsystem  (MPS)  to  Remote  Monitoring  Subsystems 
(RMS)  and  Remote  Monitoring  Subsystem 
Concentrators  (RMSC) ,  June  10,  1986. 

Remote  Maintenance  Monitoring  System  Functional 
Requirements  for  the  Remote  Monitoring  Subsystem 
(RMS),  February  28,  1986. 

FAA  Acquisition  Process,  March  19,  1993. 
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FAA  ORDER 
1810. 4B 


FAA  NAS  Test  and  Evaluation  Policy,  October  22, 
1992  . 


2.2  OTHER  DOCUMENTS. 

JSPO  NEXRAD  TEMP,  May  31,  1990. 

R400 -TP301 

R400-SP401A  NEXRAD  Technical  Requirements  (NTR) ,  1  November 

1991. 

AFOTEC  PROJECT  NEXRAD  Initial  Operational  Test  and  Evaluation 

86-0167  ( IOT&E) ,  Phase  II  Final  Report,  December  1989. 

CDRL  505  Cl  Level  Test  Procedures  for  Redundancy,  May  20, 

1993  . 

1310035A  Build  7  Test  Plan,  October  15,  1993. 

CDRL  245  Build  7  Test  Procedures,  November  1,  1993. 

DV1208251F  Critical  Item  Development  Specification  for  Tower 

Utilities  (B4,  Cl-01) . 

DV1208252G  Critical  Item  Development  Specification  for 
Antenna  Pedestal  (B2,  Cl -02) . 

DV1208253F  Critical  Item  Development  Specification  for 

Transmitter  (B2,  Cl -03) . 

DV1208254E  Critical  Item  Development  Specification  for 

Receiver/Signal  Processor  (B2,  Cl -04) . 

DV1208255F  Critical  Item  Development  Specification  for  Radar 

Data  Acquisition  (RDA)  Control  (B2,  Cl -05) . 

DV1208256E  Critical  Item  Development  Specification  for 
Wideband  Communications  Link  (B2,  Cl -06) . 

DV1208257F  Critical  Item  Development  Specification  for  Radar 

Product  Generation  (RPG)  Equipment  (Bl,  Cl -07) . 

DV1208258F  Critical  Item  Development  Specification  for 

Principle  Users  Processor/RPG  Operational  Position 
(PUP/RPGOP)  Equipment  (Bl,  CI-08) . 

DV1208250E  Critical  Item  Development  Specification  for  RDA 

Equipment  (Bl,  Cl -09) . 

CDRL  246  Production  Acceptance  Tests  For  CLIN  0001AD 

Bloomfield,  CT. 
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DESCRIPTION. 


3  . 


3.1  MISSION. 

The  NEXRAD  mission  is  to  provide  improved  aviation  safety  and 
more  efficient  use  of  airspace  through  the  detection  and  warning 
of  hazardous  weather  in  the  enroute  and  oceanic  environments. 

The  FAA  will  maintain  Offshore  NEXRAD s  in  areas  where  neither  the 
Department  of  Commerce  (DOC)  nor  the  DOD  provide  coverage,  such 
as  Alaska,  Hawaii,  and  the  Caribbean.  The  NWS  will  operate  these 
units  to  provide  weather  information  to  air  traffic  control  (ATC) 
facilities,  the  aviation  community,  and  other  principal  users. 

These  Offshore  NEXRADs  must  fully  meet  users'  requirements  for 
timely,  reliable,  and  operationally  acceptable  hazardous  weather 
and  planning  information.  The  system  must  be  supportable,  cost 
effective,  growth  adaptable,  and  be  acquired  in  accordance  with 
applicable  standards,  regulations,  and  policies. 

The  Offshore  NEXRAD  will  have  two  FAA  enhancements;  a  redundant 
channel  and  an  RMS.  The  redundant  configuration  increases  system 
availability.  Either  radar  channel  has  complete  NEXRAD  weather 
detection  capabilities.  The  RMS  will  provide  information  to  the 
RMMS . 

3.2  OFFSHORE  NEXRAD  SYSTEM. 

The  Offshore  NEXRAD  system  will  consist  of  14  radar  systems  (3  in 
the  Caribbean,  4  in  Hawaii,  and  7  in  Alaska)  with  associated 
communications,  data  processing  hardware  and  software,  display 
and  data  equipment,  documentation,  and  support  facilities. 

3.2.1  Key  Functions. 

The  Offshore  NEXRADs  will  acquire,  process,  distribute,  and 
display  weather  radar  information  to  support  the  FAA's  needs. 

The  information  includes  location,  severity,  and  movement  of  both 
routine  and  hazardous  weather  phenomena.  Primary  functional 
areas  consist  of  RDA,  RPG,  PUP,  Communications,  Facilities,  and 
Support. 

3.2.2  interfaces. 

Initially,  the  FAA  Air  Route  Traffic  Control  Centers  (ARTCC)  will 
have  access  to  NEXRAD  products  through  the  PUP  which  will  be 
installed  at  the  ARTCC.  In  the  end-state,  the  Offshore  NEXRAD 
will  disseminate  weather  products  to  the  ARTCCs  via  the  Weather 
Acquisition  and  Radar  Processor  (WARP)  routinely,  and  upon 
request . 

The  Offshore  NEXRAD  radar  will  provide  weather  products  to  the 
National  Oceanic  and  Atmospheric  Administration  ( NOA A ) ,  DOD,  and 
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other  users  as  required.  The  NEXRAD  also  will  transmit 
maintenance  data  to  the  MPS. 

Figure  3. 2. 2-1  shows  a  simplified  block  diagram  of  the  NEXRAD 
interfaces.  The  WARP  and  RMS  are  not  yet  available  for  testing. 
Note  that  for  Offshore  NEXRAD  systems,  the  ARTCC  equivalent  is 
the  Center  Radar  Approach  Control  (CERAP)  and  does  not  have  a 
Central  Weather  Service  Unit  (CWSU)  composed  of  trained 
meteorologists  to  interpret  weather  data. 

3.2.3  Unique  Characteristics. 

The  NEXRAD  has  the  capability  to  accurately  measure  weather 
reflectivity  and  velocity,  which  is  necessary  for  detecting  and 
forecasting  hazardous  aviation  weather  events. 

3.3  REQUIRED  OPERATIONAL  CHARACTERISTICS. 

The  following  are  required  operational  characteristics  for  the 
Offshore  NEXRAD  in  the  context  of  this  TEMP: 

a.  Possess  an  overall  system  Mean  Time  Between  Failures 
(MTBF)  of  4037  hours  and  an  availability  of  0.99987616; 

b.  Possess  the  capability  to  monitor  and  provide 
maintenance  status  to  the  Maintenance  Data  Terminal  (MDT)  and  the 
MPS  in  accordance  with  NAS -SS- 1000,  volume  V  requirements; 

c.  Possess  the  capability  to  predict  aviation  related 
hazardous  conditions.  These  phenomena,  which  are  not  mutually 
exclusive,  include  the  following:  precipitation,  wind  and  wind 
shear,  tornadoes,  fronts/fine  lines,  hurricanes,  tropical 
cyclones,  mesocyclones ,  thunderstorms,  turbulence,  hail  and 
freezing/melting  level; 

d.  Possess  an  RMS  MTBF  of  11900  hours  and  an  availability 
of  0.99995799. 

Reliability  and  availability  figures  are  per  NAS -SS- 1000,  volume 

I. 

3.4  REQUIRED  TECHNICAL  CHARACTERISTICS. 

Detailed  technical  characteristics  are  defined  in  section  3  of 
the  NTR .  The  redundant  configuration  specifications  are  defined 
in  section  3. 2. 1.5.1  of  the  NTR  and  have  been  modified  by 
Contract  Modification  0078  and  0123  for  NWS/FAA  Redundant 
Configurations.  The  NEXRAD,  in  the  context  of  this  TEMP,  shall 
have  the  following: 

a.  An  RMS  capable  of  supporting  NAS -SS- 1000,  volume  V 
requirements ; 
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NOAA 
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DOD 
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VENDORS 

(EXTERNAL  TO  NAS) 


FIGURE  32.2-1.  NEXRAD  INTERFACE  BLOCK  DIAGRAM 
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b.  Redundant  hardware  which  will  enable  the  NEXRAD  to 
achieve  the  operational  requirements  for  reliability  and 
availability.  RDA,  RPG  functional  area  equipment,  wideband  and 
narrowband  communications  will  be  redundant.  The  antenna, 
pedestal,  tower,  and  backup  power  generator  will  not  be 
redundant ; 

c.  Processing  software  capable  of  supporting  a  redundant 
system  while  meeting  existing  operational  requirements  identified 
in  the  Verification  Requirements  Test  Matrix  (VRTM)  (appendix  A) . 

3.5  CRITICAL  OPERATIONAL  ISSUES  (COI) . 

3.5.1  Critical  DT&E  Issues. 

No  critical  DT&E  issues  were  identified  during  the  redundant 
configuration  development  testing  at  the  contractor  facility. 

RMS  development  has  not  started. 

3.5.2  Critical  OT&E  Issues. 

The  following  are  critical  OT&E  issues  of  the  Offshore  NEXRAD s : 

a.  Inadequate  test  time  to  fully  evaluate  required  system 
availability; 

b.  Due  to  the  proximity  of  testing,  scheduling  and 
coordination  will  be  critical  to  the  successful  testing  of  this 
system. 

3.6  TEST  STRATEGY. 

The  testing  strategy  for  the  Offshore  NEXRAD  will  be  performed  in 
two  phases:  Phase  1,  redundant  configuration  testing,  will  take 
place  in  1994,  at  two  locations:  the  factory  in  Great  Neck,  New 
York  and  Kauai,  Hawaii;  and  Phase  2,  RMS  testing,  will  take  place 
in  1998,  at  a  site  to  be  determined  (TBD) .  The  test  strategy 
will  be  responsible  for: 

a.  Ensuring  the  redundant  NEXRAD  provides  comparable 
performance  upon  reconfiguration.  Response  times  must  meet 
existing  NAS  time  constraints; 

b.  Ensuring  that  the  system  can  be  easily  and  rapidly 
restored  to  operational  status  following  a  failure  in  the 
redundant  configuration; 

c.  Ensuring  the  RMS  provides  accurate  and  timely 
information  to  the  MPS. 

Testing  to  ensure  redundancy  and  RMS  requirements  are  met  will  be 
accomplished  through  DT&E  including  Site  Acceptance  Testing 
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(SAT),  OT&E  Integration,  OT&E  Operational,  OT&E  Shakedown,  PAT&E , 
and  Field  Shakedown. 

3.7  MINIMUM  OPERATIONAL  PERFORMANCE. 

The  minimum  operational  performance  criteria  for  the  Offshore 
NEXRAD  can  be  divided  into  two  categories;  technical  and 
functional.  Minimum  technical  performance  criteria  is  defined 
quantitatively  in  the  VRTM  and  defines  physical  operating 
performance  required  from  the  Offshore  NEXRAD  system.  This  type 
of  data  is  typically  associated  with  minimum  and/or  maximum 
performance  parameters.  Minimum  functional  performance  criteria 
is  defined  qualitatively  in  FAA  Order  1810. 4B  and  NAS -SS- 1000  and 
is  a  measure  of  the  effectiveness  of  the  system  at  performing  the 
required  tasks.  OT&E  testing  will  address  both  categories  of 
minimum  operational  performance  and  identify  any  deficiencies  in 
either  category. 


4.  PROGRAM  SUMMARY. 

4 . 1  MANAGEMENT . 

The  following  paragraphs  describe  the  management  process  and  the 
participating  organizations'  roles  and  responsibilities. 

4.1.1  Weather  Radar  Program  Office. 

The  Weather  Radar  Program  Office,  ANR-500,  is  responsible  for  the 
overall  management  of  the  Offshore  NEXRAD  program,  from  the 
acquisition  and  implementation  through  the  Operational  Readiness 
Demonstration  (ORD) . 

The  Program  Office  is  supported  by  the  following  Associate 
Program  Managers  (APM) : 

a.  APM  for  Engineering  ( APME) , 

b.  APM  for  Logistics  (APML) , 

c.  APM  for  Maintenance  (APMM) , 

d.  APM  for  Requirements  (APMR) , 

e.  APM  for  System  Engineering  (APMSE) , 

f .  APM  for  Test  (APMT) . 

4.1.2  Test  Policy  Review  Committee  (TPRC) . 

The  Chairperson  of  the  TPRC  will  support  Test  and  Evaluation 
(T&E)  policy,  test  standards,  and  definitions.  The  TPRC  is 
responsible  for  approving  the  TEMP  and  revisions  to  the  TEMP,  as 
well  as  approving  test  policy  waivers  and  resolving  disagreements 
on  T&E  issues  when  agreements  cannot  be  reached  at  lower  levels 
of  FAA  Management. 
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4.1.3  APMT . 


The  APMT  is  from  the  Weather/Primary  Radar  Division,  ACW-200, 
organization  located  at  the  FAA  Technical  Center.  It  is  the 
responsibility  of  the  Program  Manager  (PM)  and  APMT  to  develop  a 
TPRC  approved  Offshore  NEXRAD  TEMP. 

The  APMT  has  the  responsibilities  as  detailed  in  FAA  Order 
1810. 4B.  The  APMT  will  be  responsible  for  conducting  overall 
OT&E  activities,  specifically  OT&E  Operational  and  OT&E 
Integration,  which  are  subsets  of  OT&E  testing.  ACW-200D  will 
prepare  test  plans,  test  procedures,  and  test  reports  for  ANR- 
500. 

The  APMT  has  established  a  Test  Planning  Working  Group  (TPWG)  to 
coordinate  testing  and  address  test  issues.  The  APMT  will  also 
be  responsible  for  tracking  and  ensuring  the  resolution  of 
program  trouble  reports  resulting  from  these  test  efforts. 

4.1.4  Operational  Support  Services  -  Radar  Engineering  Support 
Branch. 

The  Radar  Engineering  Support  Branch,  AOS -230,  will  conduct  OT&E 
Shakedown  at  the  redundant  configuration  site  in  Kauai,  Hawaii. 
AOS  -  230  will  also  have  responsibility  for  RMS  Shakedown. 

4.1.5  Regional  Responsibility. 

Field  Shakedown  testing  will  be  conducted  by  the  corresponding 
regions;  Southern,  Alaska,  and  Western  Pacific  (e.g.,  Western 
Pacific  Region  (AWP)  will  conduct  Field  Shakedown  testing  on  all 
sites  within  their  region) . 

4.1.6  Unisys  Corporation  Responsibility. 

The  contractor  will  be  responsible  for  the  planning,  conduct,  and 
analysis  of  all  contractually  required  testing  in  accordance  with 
the  Statement  of  Work  (SOW)  and  the  Contract. 

4.1.7  National  Engineering  and  Field  Support  Division 
Responsibility. 

The  National  Engineering  and  Field  Support  Division,  AOS -200, 
will  coordinate  the  RMS  procurement  for  the  Offshore  NEXRAD 
Program.  AOS -200  will  plan  and  conduct  testing  in  accordance 
with  FAA  Order  1810. 4B. 

4.2  OFFSHORE  NEXRAD  INTEGRATED  SCHEDULE. 

The  schedule  presented  in  appendix  B  depicts  the  NEXRAD 
Integrated  Test  Schedule.  It  is  anticipated  that  the  redundant 
configuration  installation  will  be  completed  prior  to  completion 
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of  any  RMS  test  events.  The  schedule  will  be  updated  as  changes 
occur.  Fiscal  year  1997  is  the  earliest  expected  date  for  the 
RMS. 

4 . 3  TEST  PLANS . 

ACW-200D  will  develop  the  OT&E  Integration  and  OT&E  Operational 
Test  Plan  and  Procedures  in  accordance  with  FAA  Order  1810. 4B  and 
FAA-STD-024B. 

The  ATC  Sustaining  Engineering  Branch,  ACN-100D,  will  develop  RMS 
OT&E  Integration  and  OT&E  Operational  test  plans,  procedures,  and 
test  reports. 

AOS-230  will  develop  the  OT&E  Shakedown  Test  Plan  and  Procedures 
in  accordance  with  FAA  Order  1810. 4B.  These  plan  and  procedures 
will  ensure  shakedown  is  conducted  per  FAA  Order  1810. 4B 
direction.  Table  4.3-1  identifies  test  documents  and  their 
responsible  organizations.  Appendix  B  identifies  expected 
delivery  dates  for  these  documents . 

4.4  TEST  PROCEDURES. 


Test  procedures  will  be  provided  for  all  of  the  test  plans 
described  above.  The  test  procedures  will  be  identified  in  the 
appropriate  test  plans.  Test  procedures  will  provide  step-by- 
step  instructions  for  preparation,  execution,  termination,  and 
documentation  of  tests. 

4.5  TEST  REPORTS. 

The  test  reports  will  document  the  results  of  formal  testing. 
Test  reports  will  evaluate  the  system's  compliance  with  the  NTR, 
NAS -SS- 1000,  and  operational  requirements.  Contractor  test 
reports  will  be  submitted  in  accordance  with  the  contract. 
Government  test  reports  are  the  responsibility  of  the  APMT  and 
AOS -200,  and  will  be  written  in  accordance  with  1810. 4B  and  FAA- 
STD-024B. 
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TABLE  4.3-1.  TEST  DOCUMENTS 


DOCUMENT  TITLE 

RESPONSIBLE 

ORGANIZATION 

Offshore  NEXRAD  TEMP 

APMT  -  ACW-200D 

DT&E  Plan  -  Redundant  Configuration 

Unisys 

DT&E  Plan  -  RMS 

TBD 

OT&E  Integration  and  OT&E  Operational 
Plan  -  Redundant  Configuration 

APMT  -  ACW-200D 

OT&E  Integration  Plan  -  RMS 

APMT  -  ACN -100  ; 

OT&E  Operational  Plan  -  RMS 

APMT  -  ACN- 100 

OT&E  Shakedown  Redundancy  Test  Plan 

AOS  -  230 

5.  DT&E  AND  PAT&E  SCOPE,  EVENTS,  SCENARIOS. 

DT&E  will  ensure  that  the  redundancy  and  RMS  designs  are  in 
accordance  with  product  specifications.  The  redundancy  DT&E  will 
be  conducted  at  Unisys.  The  organization  responsible  for  DT&E 
testing  of  the  RMS  is  TBD .  PAT&E  will  be  conducted  by  Unisys  for 
the  redundant  configuration  without  the  RMS  enhancement.  PAT&E 
will  be  conducted  by  the  responsible  developers  prior  to  Field 
Shakedown.  The  RMS  developers  are  TBD  and  will  be  procured  under 
a  separate  competitive  contract. 

5.1  DT&E /PAT&E  TO  DATE. 

The  JSPO  NEXRAD  has  been  extensively  tested  by  AFOTEC.  DT&E  of 
the  redundant  channel  configuration  has  been  performed  by  Unisys. 
A  Factory  System  Test  was  successfully  performed  by  Unisys  on  the 
redundant  configuration.  No  PAT&E  to  date  has  been  performed  on 
a  redundant  configuration.  Formal  test  reports  have  not  been 
completed.  No  RMS  DT&E  has  been  performed  to  date. 

5.2  FUTURE  DT&E /PAT&E . 

Unisys  will  perform  the  redundant  configuration  PAT&E.  AOS-200 
will  procure  the  RMS  portion  of  the  system  in  conjunction  with 
the  Program  Office,  and  will  test  the  RMS  relative  to  shakedown 
requirements.  The  schedule  for  RMS  testing  is  included  in 
appendix  B. 

5.3  CRITICAL  DT&E /PAT&E  ITEMS. 


Unisys  has  completed  hardware  and  software  DT&E  of  the  redundant 
configuration.  ACW-200  monitored  testing  and  observed  no  COIs. 


6.  OT&E  INTEGRATION ,  OT&E  OPERATIONAL,  AND  OT&E  SHAKEDOWN. 


The  FAA  will  conduct  OT&E  Integration,  OT&E  Operational,  and  OT&E 
Shakedown  testing  on  the  redundant  system.  OT&E  Operational  and 
OT&E  Shakedown  testing  of  the  RMS  will  begin  after  the  Interim 
Monitor  and  Control  Software  (IMCS)  module  has  passed  Confidence 
Testing. 

Any  deficiencies  identified  during  OT&E  testing  will  be  logged  as 
program  trouble  reports.  The  program  trouble  report  is  the 
vehicle  for  resolving  the  deficiency.  The  APMT  will  provide  all 
program  trouble  reports  to  the  Program  Office  and  recommendations 
for  resolving  the  deficiency. 

6.1  OT&E  TO  DATE. 

No  OT&E  to  date  has  been  performed  on  the  redundant  configuration 
enhancement  or  the  RMS  enhancement. 

Full  Phase  A  OT&E  was  performed  on  the  contractor's  single 
channel  prototype  system  in  1986.  OT&E  Phase  B  was  conducted  on 
the  contractor's  prototype  system  in  1987.  An  integrated,  tri- 
agency  (DOC,  DOD,  DOT)  test  team,  under  the  overall  management  of 
AFOTEC,  conducted  the  Initial  OT&E  Phase  II  of  the  NEXRAD  between 
March  and  August  of  1989,  at  three  sites:  Norman,  Oklahoma; 

Tinker  Air  Force  Base;  and  Oklahoma  City,  Oklahoma. 

OT&E  Shakedown  was  performed  on  the  PUP  by  AOS -230  at  the 
Washington  ARTCC  in  Leesburg,  Virginia,  during  September  1992. 
OT&E  Operational  testing  was  performed  on  the  PUP  at  the 
Washington  ARTCC  during  the  week  of  March  22,  1993,  by  ACW-200D, 
and  at  the  Houston  ARTCC  (Houston,  Texas)  during  the  week  of 
March  29,  1993. 

6.2  OT&E  INTEGRATION  TEST  SCOPE,  EVENTS,  SCENARIOS. 

The  OT&E  Integration  test  objective  is  to  assess  the  Offshore 
NEXRAD 's  capability  to  interface  with  other  NAS  systems  such  as 
the  MPS.  Redundant  configuration  OT&E  Integration  will  be 
accomplished  in  Kauai,  Hawaii.  No  site  has  yet  been  identified 
for  RMS  OT&E  Integration  testing.  Except  for  the  RMS  to  MPS  and 
WARP  interfaces.  Offshore  NEXRAD  weather  radar  sites  are 
essentially  stand-alone.  OT&E  integration  test  objectives  are: 

a.  Verify  the  redundant  configuration  interface  operates  in 
accordance  with  NAS  requirements; 

b.  Verify  that  the  RMS  properly  interfaces  with  the  MPS. 

ACW-200D  will  draft  an  integration  and  operational  test  plan  to 
ensure  the  redundant  features  of  NEXRAD  comply  with  the  VRTM 
requirements  presented  in  this  plan.  ACN-100D  will  develop  an 
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integration  test  plan  and  test  procedures  to  ensure  that  the  RMS 
interfaces  with  the  MPS  in  accordance  with  the  NAS  requirements 
presented  in  this  plan. 

6.3  OT&E  OPERATIONAL  TEST  SCOPE,  EVENTS,  SCENARIOS. 

Although  AFOTEC  conducted  an  extensive  operational  evaluation  on 
the  JSPO  NEXRAD ,  some  OT&E  Operational  requirements  will  be 
evaluated  in  accordance  with  FAA  Order  1810. 4B.  The  purpose  is 
to  ensure  that  the  operational  requirements  have  not  been 
degraded  due  to  the  enhancements.  The  test  scope  will  consist  of 
testing  the  following  for  compliance  with  applicable  VRTM  and  FAA 
Orders : 

a.  Reliability, 

b.  Degraded  Operations, 

c.  Maintainability, 

d.  Availability, 

e.  Security, 

f.  Safety, 

g.  Adaptation  Data. 

Test  scenarios  will  be  identified  in  the  OT&E  Integration  and 
OT&E  Operational  plan. 

6.4  OT&E  SHAKEDOWN  SCOPE,  EVENTS,  SCENARIOS. 

OT&E  Shakedown  will  be  conducted  at  the  first  operational  site. 
Selected  areas  of  concern  found  during  OT&E  Integration  may  be 
retested  in  the  actual  operational  environment.  The  scope  of 
testing  will  evaluate  field  suitability  and  effectiveness  of  the 
following: 

a.  RMS  and  redundant  configuration, 

b.  Training, 

c.  Documentation. 

Air  conditioning,  power  distribution,  cable  routing,  utility 
ground  bus,  and  communication  line  discrepancies  will  be 
identified.  Logistics  support  issues  also  will  be  addressed. 

6.5  CRITICAL  OT&E  ISSUES. 

A  critical  area  previously  identified  from  JSPO  NEXRAD  test 
program  was  the  system's  reliability  and  availability 
performance.  Reliability  and  maintainability  data  will  be 
collected  and  analyzed  during  both  the  RMS  and  redundant 
configuration  testing. 
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7. 


SPECIAL  RESOURCE  SUMMARY. 


7.1  TEST  ARTICLES. 

A  total  of  14  Offshore  NEXRADs  will  be  procured  under  this 
acquisition:  3  in  the  Caribbean,  4  in  Hawaii,  and  7  in  Alaska. 

All  of  these  sites  will  require  PAT&E  and  Field  Shakedown.  First 
site  testing  will  be  performed  in  Kauai,  Hawaii,  on  the  redundant 
configuration.  The  redundant  configuration  will  be  tested  in 
1994.  Testing  of  the  RMMS -configured  Offshore  NEXRAD  will  be 
determined  by  funding  availability,  no  earlier  than  fiscal  year 
1997. 

7.2  SPECIAL  SUPPORT  REQUIREMENTS. 

Radar  technicians  and  engineers  trained  in  the  operation  and 
maintenance  of  NEXRAD  will  be  required  to  support  OT&E 
Integration  and  OT&E  Shakedown.  Easy  access  to  spare  parts  will 
be  required  in  order  to  minimize  potential  downtime  resulting 
from  equipment  failures  during  testing.  Expertise  in  doppler 
weather  meteorology  also  will  be  required  to  perform  OT&E 
Integration  and  OT&E  Operational  testing.  IMCS  confidence 
testing  will  require  the  skills  of  trained  radar  technicians. 

Test  equipment  normally  required  to  support  site  operation  will 
be  required. 

7 . 3  PERSONNEL  REQUIREMENTS . 

The  following  is  a  list  of  personnel  requirements: 

a.  ACW-200D  will  require  test  engineers  to  draft  plans  and 
procedures,  conduct  testing,  and  draft  reports; 

b.  AOS -200  will  require  test  personnel  to  accomplish 
program  monitoring  and  accommodate  test  activities; 

c.  Regional  manpower  will  be  required  for  system  and 
maintenance  support  (two  maintenance  technicians  and  one  operator 
at  the  Unit  Control  Position  (UCP) ) .  A  meteorologist  for  the  PUP 
will  be  required  and  located  at  the  CERAP  and/or  NWS  in  Honolulu; 

d.  FAA  Technical  Center  will  need  to  provide  personnel  for 
the  duration  of  OT&E  Integration  and  OT&E  Operational  testing, 

e.  Meteorological  support  will  be  requested  from  the  NWS 
for  weather  support  for  the  duration  of  the  test, 

f.  ACN-100D  will  require  RMS  test  plan,  test  procedure 
writers,  and  engineers  to  conduct  RMS  testing. 
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7.4  SPECIAL  SUPPORT  REQUIREMENTS. 


7.4.1  MPS  Simulator. 

Synchronous  Enhanced  MPS  Communications  Simulator  and  LMl 
Protocol  Analyzer  (version  8.0)  will  be  required  for  testing  link 
level  communications. 

7.4.2  Software. 

RMS- -MPS  testing  will  require  updated  IMCS,  RMS  Terminal 
Software,  and  Procomm  software  for  the  MDT.  Database  software, 
such  as  DBIV,  should  be  procured  and  used  for  analysis  of  the 
failure  data. 

7.5  TRAINING  REQUIREMENTS. 

Currently,  DOD,  NWS,  and  FAA  personnel  are  trained  in  the 
operation  of  single -channel  NEXRAD  systems  at  the  Keesler  Air 
Force  Base,  Mississippi.  The  training  manuals  which  explain 
operation  and  maintenance  of  the  redundant  configuration  are  not 
formalized  and  currently  not  available.  Operators  and 
technicians,  therefore,  will  be  inexperienced  in  the  operation 
and  maintenance  of  an  FAA  redundant  configuration. 

Training  prior  to  the  test  will  be  required.  Training  of  FAA 
Technical  Center  government  and  contractor  support  test  personnel 
will  encompass  various  instructional  and  self  - learning  processes 
in  preparation  for  the  OT&E  Operational  testing  of  the  Offshore 
NEXRAD . 

Reading  of  technically  related  NEXRAD  literature  will  be  the 
basic  and  chief  medium  of  gaining  familiarization  with  the 
system.  The  various  forms  of  informational  reading  will  include: 
NAS  publications  related  to  NEXRAD,  single -channel  NEXRAD 
operation  and  maintenance  instructions,  NEXRAD  Technical 
Requirements  (NTR) ,  JSPO  NEXRAD  Test  Plans  and  Reports,  FAA 
Headquarters'  generated  documents  and  other  FAA  orders. 

The  Meteorologist  required  from  the  NWS  must  be  familiar  with 
interpreting  NEXRAD  weather  data.  This  will  require  the 
interpretation  of  two  sets  of  NEXRAD  base  products  from  sites 
that  are  not  collocated. 

7.6  FUNDING  REQUIREMENTS. 

Table  7.6-1  is  a  cost  estimate  for  the  testing  at  the  first  site 
in  Kauai,  Hawaii.  The  estimate  is  based  on  several  assumptions 
including  a  1 -month  test  time  for  ACW  and  1 -month  test  time  for 
AOS.  Also,  the  estimate  assumes  no  major  failures  during  testing 
which  would  cause  excessive  downtime.  Other  assumptions  include 
a  4 -percent  yearly  increase  in  cost,  the  Alaskan  Region  (AAL)  and 
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Southern  Region  (ASO)  funding  to  participate  in  testing,  and  NWS 
support  for  testing  is  provided  without  charge.  The  Kauai  Sector 
Field  Office  (SFO)  has  estimated  their  requirements  as  indicated. 
Operational  Support  Facility  (OSF)  support  may  be  required, 
however,  at  this  time  no  OSF  on-site  support  for  OT&E  Integration 
and  OT&E  Operational  testing  is  scheduled. 


TABLE  7.6-1.  COST  ESTIMATE  FOR  OFFSHORE  NEXRAD  OT&E  TESTING 

FY  (K$) 


OT&E  INT./OP. 

94 

95 

96 

APMT 

22.50 

23.40 

24.34 

CONTRACTOR 

SUPPORT 

240.00 

249.60 

259.58 

KAUAI  SFO 

10.00 

- 

- 

OSF* 

- 

- 

- 

ASO 

15.00 

- 

- 

AAL 

20.00 

- 

- 

OT&E  SHAKEDOWN 

94 

95 

96 

AOS 

45.00 

46.80 

48.67 

CONTRACTOR 

SUPPORT 

240.00 

249.60 

259.58 

KAUAI  SFO 

10.00 

- 

- 

ASO 

- 

- 

- 

OSF 

15.00 

- 

- 

AAL 

- 

- 

- 

TOTALS 

617.50 

569.40 

592.17 

3  YEAR  TOTAL 

1779.07 

*  ACW  will  require  the  OSF  only  for  secondary  support  or  in  case 
of  a  major  system  failure. 
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8 .  ACRONYMS  AND  ABBREVIATIONS . 


A 

AAL 

ACN 

ACW 

AFOTEC 

A  PM 

APME 

APML 

APMM 

APMR 

APMSE 

APMT 

ARTCC 

ASO 

ATC 

AWP 

CERAP 

CO  I 

CONUS 

CWSU 

D 

dBz 

DOC 

DOD 

DOT 

DT&E 

FAA 

GHZ 

I 

I  CD 

IOT&E 

IMCS 

JSPO 

MCCP 

MDT 

MMC 

MPS 

MTBF 

NAS 

NEXRAD 

NOAA 

NTR 

NWS 

ORD 

OSF 

OT&E 

PAT&E 

PM 

PMO 


Analysis 

FAA,  Alaskan  Region 

Engineering,  Test  and  Evaluation  Service 
Engineering,  Integration,  and  Operational  Evaluation 
Service 

Air  Force  Operational  Test  and  Evaluation  Center 

Associate  Program  Manager 

Associate  Program  Manager  for  Engineering 

Associate  Program  Manager  for  Logistics 

Associate  Program  Manager  for  Maintenance 

Associate  Program  Manager  for  Requirements 

Associate  Program  Manager  for  System  Engineering 

Associate  Program  Manager  for  Test 

Air  Route  Traffic  Control  Center 

FAA,  Southern  Region 

Air  Traffic  Control 

FAA,  Western  Pacific  Region 

Center  Radar  Approach  Control 

Critical  Operational  Issue 

Continental  United  States 

Central  Weather  Service  Unit 

Demonstration 

Measure  of  Reflectivity 

Department  of  Commerce 

Department  of  Defense 

Department  of  Transportation 

Development  Test  and  Evaluation 

Federal  Aviation  Administration 

Gigahertz 

Inspection 

Interface  Control  Document 
Initial  Operational  Test  and  Evaluation 
Interim  Monitor  and  Control  Software 
Joint  System  Program  Office 
Maintenance  Control  Center  Processor 
Maintenance  Data  Terminal 
Maintenance  Monitor  Console 
Maintenance  Processor  Subsystem 
Mean  Time  Between  Failure 
National  Airspace  System 
Next  Generation  Weather  Radar 

National  Oceanic  and  Atmospheric  Administration 

NEXRAD  Technical  Requirements 

National  Weather  Service 

Operational  Readiness  Demonstration 

Operational  Support  Facility 

Operational  Test  and  Evaluation 

Production  Acceptance  Test  and  Evaluation 

Program  Manager 

Program  Management  Office 
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PUP 

Q 

RDA 

RMMS 

RMS 

RMSC 

RPG 

RPGOP 

RTN 

SAT 

SFO 

SOW 

T 

T&E 

TBD 

TEMP 

TPRC 

TPWG 

UCP 

UTC 

VRTM 

WARP 

X 


Principal  User  Processor 
Deferred 

Radar  Data  Acquisition 

Remote  Maintenance  Monitoring  System 

Remote  Monitoring  Subsystem 

Remote  Monitoring  Subsystem  Concentrator 

Radar  Product  Generation 

Radar  Product  Generation  Operational  Position 

Return  to  Normal 

Site  Acceptance  Testing 

Sector  Field  Office 

Statement  of  Work 

Test 

Test  and  Evaluation 

To  Be  Determined 

Test  and  Evaluation  Master  Plan 

Test  Policy  Review  Committee 

Test  Plan  Working  Group 

Unit  Control  Position 

Universal  Time  Code 

Verification  Requirements  Test  Matrix 
Weather  Acquisition  and  Radar  Processor 
Not  Applicable 
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APPENDIX  A 


VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX  (VRTM) 


The  TEMP  VRTM  presents  requirements  applicable  to  the  NEXRAD 
redundant  configuration  and  RMS  testing. 

The  following  provides  VRTM  column  definitions: 

1.  REQ#  -  identification  number  is  to  reference 
requirements  throughout  the  series  of  test  documents  produced  by 
the  FAA  Technical  Center; 

2.  VOL  I  Para.  #  -  indicates  NAS -SS- 1000  volume  I  reference 
paragraph; 

3.  DESCRIPTION  -  describes  the  NAS -SS- 1000  requirement; 

4.  VERIFICATION  LEVELS: 

"DT&E"  --  Subsystem  level  (FACTORY/DT&E) 

" OT&E  (0) "  -  -  OT&E  Operational 
"OT&E  (I)"  --  OT&E  Integration 
"OT&E  (S)"  --  OT&E  Shakedown; 

5.  NAS  STATUS  is  reflected  with  a  "Q"  in  all  blocks  when 
requirements  are  deferred  to  system  unavailability; 

6.  REMARKS  --  Identifies  lead-in  paragraph  or  other 
relevant  information. 
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Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Amicable  Q=Deferred 


Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Applicable  Q=Deferred 
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Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Applicable  Q=Deferred 
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Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Applicable  Q=Deferred 
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NAS-SS-1000  REQUIREMENTS 
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Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Applicable  Q=Deferred 
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Verification  Methods:  T=Test  D=Demonstration  A=AnaIysis  I=Inspection  X=Not  Applicable  Q=Deferred 


NEXRAD 

NAS-SS-1000  REQUIREMENTS 
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Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Applicable  Q=Deferred 


Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Applicable  Q=Deferred 
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Verification  Methods:  T=Test  D=Demonstration  A=Analysis  ^Inspection  X=Not  Applicable  Q=Deferred 


5010b  3.2.1.1.1.1.3.4b  The  RMS  shall  store  alarm  and  alert  threshold  values, 

initialization  tables,  data  required  for  interpreting  addressing, 
and  control  and  adjustment  message  function  codes  in  non 
volatile  storage 


NOTE  5 

NOTE  5 

NOTE  5 

NOTE  5 

NOTE  5 
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Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Applicable  Q=Deferred 


NEXRAD 

NAS-SS-1000  REQUIREMENTS 


Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Applicable  Q=Deferred 


Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Applicable  Q=Deferred 
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Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Applicable  Q=Deferred 
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Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Applicable  Q=Defened 


NEXRAD 
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Verification  Methods:  T=Test  D=Demonstration  A=Analysis  I=Inspection  X=Not  Applicable  Q=Deferred 


NEXRAD  VRTM  NOTES 


w 

H 

O 

Z 


fS 

IT 

W 

W 

w 

w 

H 

H 

P 

H 

O 

0 

o 

0 

z 

z 

z 

z 

A-20 


APPENDIX  B 


OFFSHORE  NEXRAD  TEMP  INTEGRATED  SCHEDULE 
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Offshore  NEXRAD  TEMP  Integrated  Schedule 
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